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(54) Frame-shift detecting device, apparatus for image pickup and video recording having a 
panoramic mode 



(57) A frame-shift detecting device includes: a 
movement-vector detecting portion (4) determining a 
movement-vector between image frames by comparing 
a preceding image frame with a current image frame 
during image taking; and a frame-shift detecting portion 
(9) for summing up horizontal and vertical components 
of the movement-vector, separately in order to detect a 
shift-direction or shift-quantity of the image-pickup 
frame from the start of counting operation. A video 
recording apparatus includes: a video recording portion 



(7) for recording image frames during image taking; a 
movement-vector detecting portion (4); and a frame- 
shift detecting portion (9), and the video recording por- 
tion records a first video frame at the start of counting 
operation and a second video frame at the time when 
the frame-shift detecting portion detects that the image 
pickup frame has been shifted by a specific shift dis- 
tance. 
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Description 

BACKGROUND OF THE INVENTION 
M) Field of the Invention 

The present invention relates to a frame-shift detecting device for detecting a relative movement or shift of the 
image and a shift-angle of the frame during video picture-taking. The present invention further relates to a video-record- 
ing apparatus which is capable of recording video signals of two frames spatially continuous to each other and of dis- 
playing the frame-shift quantity using the frame-shift detecting device. 

( 2 ) Description of the Prior Art 

In the beginning, "An Image Display Apparatus" disclosed in Japanese Patent Application Laid-Open Sho 64 
No.29,064 will be described as a first prior art example. Fig.1 is a block diagram showing the prior art apparatus; and 
Fig.2 is a view showing a typical example of a display frame in this conventional apparatus. In Fig. 1 , a television camera 
511 (to be referred to as a video camera) using solid-state imaging device such as CCDs (Charge-Coupled Devices) 
etc., is mounted on a tripod 512, rotatably in horizontal and vertical directions. The video camera is added with a pen- 
dulum detector 513 for gaining information on the panned-angle of the video camera. 

The video camera has a replaceable lens 514. Any of the lenses used is a zoom lens, that is, the view-field angle 
is variable. Accordingly, the camera has a view-field angle detector 51 5 in order to detects the view-field information. In 
a panorama image processing unit 516, a CCD driver 516a generates a CCD activating signal Sa and sends it to the 
video camera 51 1 . In response to the signal Sa, the video camera! 51 1 outputs a video signal Sb, pendulum information 
Sc and view-field angle information Sd to the respective parts of the panorama image processing unit 516. 

The video signal Sb is converted into the digital signal in an A/D (analog/digital) converter 516b, and the thus con- 
verted signal is supplied to a panorama memory circuit 516c. The pendulum information Sc as well as the view-field 
angle information Sd are converted into digital signals by an A/D converter 51 6d and the digital signals are supplied to 
a timing generator 51 6e. The A/D converters 516b and 51 6d, in response to respective clock signals from the timing 
generator 51 6e, effect A/D conversion. 

The timing generator 51 6e outputs a controlling signal to a memory control circuit 516f so that a picked up image 
in each lens view-field angle may be written in the panorama memory circuit 516c or may be loaded therefrom. A D/A 
(digital/analog) converter 51 6g converts the digital image signal read out from the memory 51 6c into the analog signal 
and supplies the obtained signal as panorama signal to an indicator (not shown). 

The panorama memory circuit 516c successively stores frames of the video signal Sb from the video camera 51 1 , 
based on the pendulum information Sc and the view-field angle infuriation Sd. When the panorama memory circuit 516c 
is changed into the readout mode, in response to the control signal from the timing generator 51 6e, the video signal 
stored is read out in a prescribed order by the memory control circuit 51 6f. 

Next, the operation will be described. Referring to Fig.2, if the image-pickup direction by the video camera 51 1 is 
changed, for example, in the horizontal direction, the pendulum information Sc and the lens view-field angle information 
Sd relative to a reference direction (for example, the central angle direction of the whole pendulum) of the video camera 
51 1 are detected and outputted by detectors 513 and 51 5, respectively. Here, the view-field of lens is variable owing to 
the zoom function of the lens 51 4. 

The timing generator 51 6e, as using the detected pendulum information Sc and the lens view-field angle informa- 
tion Sd, samples the pendulum information Sc for each view-field angle and controls the memory control circuit 51 6f to 
store the image signal in association with the state of the pendulum sampled. That is, as the pendulum information 
changes by the angle of the view-field, the memory control circuit 51 6f is controlled so that the video signal for the frame 
in the state of the pendulum may be stored. 

The readout from the panorama memory circuit 516c is effected in such a manner, for example, as shown in Fig.2, 
that a panoramic video-image which corresponds to five frames in horizontal direction can be displayed by a single hor- 
izontal scan and horizontal lines are successively changed over to complete the panoramic image in the same manner. 
In Figs.1 and 2 show the example in which a lens having a view-field of 5° is used. That is, image frames obtained by 
5° in the horizontal direction are inputted into the panorama memory circuit 516c and a panoramic image consisting of 
some or several frames along the horizontal direction is all at once read out. 

Here, the panoramic image is composed of fifteen frames in total, that is, five frames along the horizontal direction 
and three frames in the vertical direction, each frame being square-shaped and consisting of 100 pixels in a horizontal 
scan line and 100 vertical scan lines. Accordingly, since the image display device configurated as above displays an 
image in the state of the pendulum for each view-field angle, based on the detected information by the lens view-field 
angle detector, it is possible to form an exact panoramic image free from overlapping or dropout of information even 
when the magnitude of the view-field angle is varied. 
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Next, description of a second prior art example will be made on "A Monitoring System" using a camera (Japanese 
Patent Application Laid-Open Hei 1 No.94,787. Fig.3 is a block diagram showing an example of the monitoring system 
installed in a cash dispenser service corner in a bank etc. In the figure, a view of the cash dispenser service corner 601 
picked up by a camera 602 is subjected to an operation in a movement detecting circuit 605 in which whether any object 

5 in the view moves is detected. If any object moving is detected, recording is started by a VTR 603 and at the same time 
the view is displayed on a monitor 604, so that monitoring of the cash dispenser service corner 601 can be done. 

In this configuration, the movement detecting circuit 605 effects comparison of a current frame with a preceding 
frame, using a memory 606 and a subtraction circuit 607 so as to detect whether any object moves. If there is an object 
moving, the system activates the VTR 603 to record the output signal from the camera 602 whereas the VTR 603 is 

10 stopped if there is no object moving. Accordingly, the VTR 603 is activated to record only when any variations occur in 
the cash dispenser service corner 601 . 

As to the above system, "An Image Composing Apparatus" (disclosed in Japanese Patent Application Laid-Open 
Hei 5 No.30,422) is presented as a third prior art example. In this apparatus, since the TV camera is moved on a scan- 
ning stage by a scanning stage controller, the video image inputted from the camera moves. Hence, the system deter- 

15 mines whether or not the image varies by detecting discrepancy between a current image and a preceding image based 
on data in which the movement of image by the moving scanning stage is taken into account. 

Next, "A Gyrosensor Built-in Camera and A Video Printer Apparatus" (Japanese Patent Application Laid-Open Hei 
6-105,21 4 will be described as a fourth prior art example. Fig. 4 is a perspective view showing a gyrosensor built-in cam- 
era. In this figure, a camera body 700 has a view-finder 701 , a shutter button 702 and a taking lens 703. A gyrosensor 

20 704 is provided on the top of the camera body 700. This gyrosensor recognizes the camera body 700 as a moving 
object and detects the movement of it. Here, the gyrosensor 704 may be incorporated inside the camera body 700. 

The gyrosensor 704 has three degrees of freedom, that is, it has a capability of detecting three-dimensional varia- 
tions. Three-dimensional axes of coordinates are assumed to be set up as follows: X-axis positive direction: the hori- 
zontal right-side, Y-axis positive direction: the vertical upward side, and Z-axis positive direction: a direction in which the 

25 taking lens is oriented to a subject. 

Figs.5A and 5B indicate a situation as follows: That is, a picture of a first frame in Fig.5B is taken in a framed state 
shown in Fig.5A, thereafter, another picture of a second frame is taken after the camera body 700 is rotated clockwise 
on the Y-axis by a required angle. Thus, the pictures shown in Fig.SB are obtained. Conversely, the second picture in 
Fig.5B is taken first, thereafter the first picture may be taken after the camera body 700 is rotated on the same axis but 

30 in the counterclockwise direction by the required angle. (In this case, however, the order of the frames in Fig.SB are 
replaced.) That is, if the information on the movement of the camera is known, it is possible to create panoramic pictures 
having more varieties. 

Figs.6(a) to 6(i) indicate frame compositions which are viewed from the finder 701 of the camera of this example 
and can be taken thereby. Now, suppose that the camera is oriented at a position shown in Fig. 6(e). In the figure, a 

35 frame of thin line in the view-finder indicates an image pickup frame while points A, B, C and D are used for informing 
position-matching. That is, an indicator 710 indicates a horizontal movement while another indicator 711 indicates a 
vertical moment, respectively. 

Consider a case that a panoramic picture as shown in Figs.5A and 5B is to be taken. In this case, as the shutter 
button 702 is pressed, the camera automatically focuses the object to take a picture in the frame of Fig.6(e) as to be a 

AO reference frame. Next, as the camera is rotated so that the right-side frame can be taken in the view-finder, the gyro- 
sensor 704 automatically recognizes the direction of Fig.6(f) and causes the horizontal and vertical indicators 710 and 
71 1 to exactly instruct the user to move the camera so that the point A in the view-finder in Fig.6(f) is positioned at the 
point D in the view-finder in Fig.6(e) while the point B in the view-finder in Fig.6(f) is positioned at the point C in the view- 
finder in Fig.6(e). As the camera is moved in conformity with the instruction and positioned in place, the shutter is acti- 

45 vated automatically or manually. 

Similarly, when the camera is moved to the direction of Fig.6(c), the horizontal and vertical indicators 710 and 71 1 
are made to instruct the user to move the camera so that the point B in the view-finder in Fig.6(c) is positioned at the 
point D in the view-finder in Fig.6(e). By such operations described above, it is possible to take any combination of 
frames as to those when the camera is vertically, horizontally or diagonally moved. 

so Next, a fifth prior art example "A display Device for Image-pickup" (Japanese Patent Application Laid-Open Hei 3 
No.38,976) will be described. Fig. 7 is a block diagram showing the display device. In the figure, a microcomputer (to be 
referred to hereinafter as a CPU) 81 1 governs the whole control of the device. 

In the figure, an analog/digital (A/D) converter 813 converts the analog image signal carrying a subject image taken 
by an image-pickup means 812, into digital image data. The output from the converter 813 is supplied to a frame mem- 

55 ory 814 so that the output is stored therein. Connected to the CPU 81 1 are the frame memory 814; a photometering 
device 81 5 for metering the brightness of a subject; a display device 81 6 for displaying a moving quantity of the subject 
image, the photo-metered point etc.; an exposure controlling unit 817; a focusing device 818 for focusing the subject; a 
focus-activating switch 819 for activating the focusing device 818; a spotting switch 820 for setting up the spotted light 
metering mode and gaining the measurement in that mode; a clear switch 821 for setting up the averaged light meas- 
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uring mode from the spotted light metering mode and gaining the measurement in that mode; and a sound generator 
822 for generating sounds in response to the movement of the subject as well as when the switches 819 to 821 are 
operated. 

The image-pickup means 812 is composed of an imaging device such as, for example, CCDs, MOSs (Metal Oxide 
semiconductors) or the like. The CPU 811 is adapted to calculate the movement of the subject based on the digital 
image data stored in the frame memory 814. 

In this case, the CPU 81 1 is adapted to read out arbitrary image data in the frame memory 814 by designating a 
horizontal address (XADR) and a vertical address (YADR). This CPU 81 1 further effect exposure calculation and focus- 
ing calculation and the like. The exposure calculation is effected based on the metered value from the photometering 
device 815 whereas the focusing calculation is effected based on the image data to calculate focal length to a subject. 

Now, a method of calculating the shift quantity of a subject by the CPU 81 1 will be described. Suppose that, a sub- 
ject image FLa shown in Fig.8A is stored in the frame memory 814. As reading out the image data, the CPU 81 1 takes 
a summation (XSUM) of the values as to brightness signal for all the pixels along the vertical direction, for example. By 
this operation, one dimensional, X-spectrum of summation signal XSa is obtained. 

In this case, since the subject image FLa has a dark object like a tree extending along the vertical direction, the 
summation signal XSa as to that portion has lower values than the level of the other areas, as seen in Fig.8B. Subse- 
quently, the CPU 81 1 takes another summation (YSUM) of the values as to brightness signal for all the pixels along the 
horizontal direction, for example, whereby one dimensional, Y-spectrum of summation signal YSa is obtained. In this 
case, since the subject image FLa has a light object like sky spreading along the horizontal direction, the summation 
signal XSa as to that portion has higher values than the level of the other areas, as seen in Fig.8C. The thus detected 
horizontal (or X-directional) summation signal XSa and vertical (or Y-directional) summation signal YSa are temporarily 
stored in an unillustrated memory means such as a RAM (random access memory) or the like provided in the CPU 81 1 . 

Suppose that the camera is moved right above from aforementioned position so that a subject image FLb as shown 
in Fig.9A is obtained. In this position, the CPU 81 1 similarly, detects X-directional and Y-directional summation signals 
XSb and YSb. In this case, the X-directional summation signal XSb and Y-directional summation signal YSb are in the 
forms of the spectrums shown in Figs.9B and 9C. respectively. 

In this way, as the X-directional and Y-directional summation signals XSa and YSb as to the subject image FLa and 
the X-directional and Y-directional summation signals XSb and YSb as to the subject image FLb are detected, respec- 
tively, the CPU 811 effects a calculation of a shift quantity in the horizontal direction, for example, as to the subject 
image frame. That is, The CPU 81 1 calculate the horizontal shift quantity of the subject image frame based on the cor- 
relative operation between the two X-directional summation signals XSa and XSb. In practice, the CPU 81 1 succes- 
sively calculates absolute differential values between the two X-directional summation signals XSa and XSb by shifting 
the X-directional summation signal XSb as to the subject image FLb little by little relative to the X-directional summation 
signal XSa as to the subject image FLa, in order to seek a minimum absolute differential value. Based on this calcula- 
tion, the CPU 81 1 determines the quantity where the minimum value is obtained, as to be the horizontal shift quantity 
of the subject image frame. 

In the first prior art example (Japanese Patent Application Laid-Open Sho 64 No.29,064) described heretofore, the 
attaching precision of the video camera to the tripod is important in order to detect an exact view-field angle. When 
image taking is effected by the method set forth, a video camera having a view-field angle detector of the above- 
described type should be used with a tripod having a pendulum detector. Accordingly, the apparatus was very costly. In 
order to effect exact panning/tilting operation of the video camera, it is necessary to use a rigid tripod. As a result, it was 
difficult to make the apparatus compact and light-weighted so that this configuration was very inconvenient for being 
carried or moved. 

In the aforementioned second prior art example (Japanese Patent Application Hei 1 No.94,787), the video image 
is recorded when and only when the subject image in the frame changes. Therefore, this configuration is unfavorable to 
be applied to a portable type video camera because the subject image changes every time when the portable video 
camera is used. That is, the image is always recorded every time panning and tilting are effected using the portable 
video camera. 

In the third prior art example (Japanese Patent Application Hei 5 No.30,422), the system searches variations of the 
current video image from the previous video image and effects recording or data transmitting of that portion. Therefore, 
it is impossible to detect that the image moves by an arbitrary amount of shift and effect recording. Further, in this prior 
art example, the variation of the image is detected based on the movement of the scanning stage. As in this conven- 
tional configuration, after the image data between before and after movement is correlated by electrically shifting the 
relative position of the current data to the previous data, a new image portion, if any, is detected from the magnitude of 
the correlated value. In such a case, despite that the image frame is not moved, the system could erroneously detect 
that the image frame is changed even when an image which has nothing to do with the previous image appears sud- 
denly in the image frame. 

In the fourth conventional example described above (Japanese Patent Application Hei 6 No.105,214), a gyro is 
used to detect the shift quantity. A gyro is an angular speed sensor, therefore, it is possible to determine the shift-angle 
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by calculating a product of the angular speed and the time. Nevertheless, if a lens system having a zooming mechanism 
which allows the view-field angle to continuously be varied is used, the shift-angle equivalent to one-image frame differs 
depending on the zoomed position. That is, this conventional configuration is not constructed in view of such a system 
having a zoom lens, so that the application of the conventional configuration to the lens system with a zoom mechanism 
5 is unfavorable. 

In the fifth prior art example described above (Japanese Patent Application Hei 3 No.38,976), the moved quantity 
of the image-pickup frame is determined by searching a shift quantity at which the absolute differential value between 
the current summation signal and the previous summation signal takes a minimum value as the summation signal of 
the brightness signal of the current video image is shifted relative to the summation signal of the brightness signal of 

10 the previous video image. Accordingly, if a view in which, for example, several trees having similar sizes are present by 
approximately like distances, is taken, there appear some places where the absolute differential value takes a minimum 
value as the current summation signal is shifted relative to the previous summation signal in either direction. Therefore, 
it could become hard, in some cases, to determine in which directions the camera is shifted. Due to such an erroneous 
detection, the indicator for informing the operator of the moved direction could indicate an opposite direction to the 

15 direction in which the camera is actually moved or the indicator suddenly could jump irregularly. To make matters worse, 
it was impossible for the operator to know whether the detected data is correct or not. 

SUMMARY OF THE INVENTION 

20 It is therefore an object of the invention to provide a frame-shift detecting device which, without using a tripod with 
a pendulum detector, is able to precisely detect the movement of the image-pickup frame without being confused by 
partial movement. 

It is another object of the invention to provide a video recording apparatus which is able to record and reproduce 
two spatially correlated frames before and after a movement by precisely detecting the movement of the image-pickup 
25 frame. 

It is a third object of the invention to provide a video recording apparatus which is able to display an exact shift 
quantity of the image-pickup frame and a shift direction thereof on the monitor portion by precisely detecting the move- 
ment of the image-pickup frame, thus making it possible for the operator to move the image-pickup frame with precision. 
Further, it is still another object of the invention to provide a video recording apparatus which is able to automati- 
30 cally control the rotation of the camera within a specified shift range by precisely detecting the movement of the image- 
pickup frame. 

The present invention has been achieved to attain the above objects and the gist of the invention is as follows: 
A frame-shift detecting device in accordance with a first feature of the invention, comprises: an image-pickup por- 
tion outputting the video signal of picked up image frames; a movement-vector detecting portion determining a move- 

35 ment-vector between image frames by comparing a preceding image frame with a current image frame by a field or by 
a frame as a unit, the image frames being formed from the video signal from the image-pickup portion; and a frame- 
shift detecting portion for summing up horizontal and vertical components of the movement-vector, separately in order 
to detect a shift-direction or shift-quantity of the image-pickup frame from the start of counting operation. 

A frame-shift detecting device in accordance with a second feature of the invention, comprises: an image-pickup 

40 portion outputting the video signal of picked up image frames; a movement-vector detecting portion determining a 
movement-vector between image frames by comparing a preceding image frame with a current image frame by afield 
or by a frame as a unit, the image frames being formed from the video signal from the image-pickup portion; and a view- 
field shift angle calculating portion for determining a horizontal or vertical view-field shift angle, and is constructed such 
that the horizontal or vertical view-field shift angle is determined by the steps of: summing up horizontal or vertical com- 

45 ponents of the movement-vector, separately to determine a horizontal or vertical shift-quantity of the image-pickup 
frame; and calculating the shift angle in question, based on the shift-quantity, a predetermined shift quantity for one- 
frame and a predetermined view-field angle for one-frame. 

A video recording apparatus in accordance with a third feature of the invention, comprises: an image-pickup portion 
outputting the video signal of picked up image frames; a video recording portion for recording the video signal by afield 

so or a frame as a unit; a movement-vector detecting portion determining a movement-vector between image frames by 
comparing a preceding image frame with a current image frame by a field or by a frame as a unit, the image frames 
being formed from the video signal from the image-pickup portion; and a frame-shift detecting portion for summing up 
horizontal and vertical components of the movement-vector, separately in order to detect a shift-direction or shift-quan- 
tity of the image-pickup frame from the start of counting operation, and is constructed such that the video recording por- 

55 tion records first video information as to a first frame at the start of counting operation and second video information as 
to a second frame at the time when the frame-shift detecting portion detects that the image pickup frame has been 
shifted by a predetermined shift quantity. 

A video recording apparatus in accordance with fourth feature of the invention, comprises: an image-pickup portion 
outputting video signal of picked up image frames; a video recording portion for recording the video signal by a field or 
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a frame as a unit; a movement-vector detecting portion determining a movement-vector between image frames by com- 
paring a preceding image frame with a current image frame by a field or by a frame as a unit, the image frames being 
formed from the video signal from the image-pickup portion; and a frame-shift detecting portion for summing up hori- 
zontal and vertical components of the movement-vector, separately in order to detect a shift-direction or shift-quantity 

5 of the image-pickup frame from the start of counting operation, and is constructed such that the video recording portion, 
as recording the video signal continuously, records a first pilot signal at the start of counting operation and a second 
pilot signal at the time when the frame-shift detecting portion detects that the image pickup frame has been shifted by 
a predetermined shift quantity. 

A video recording apparatus in accordance with a fifth feature of the invention, comprises: an image-pickup portion 

w outputting the video signal of picked up image frames; a video recording portion for recording the video signal by a field 
or a frame as a unit; a monitor portion displaying the image frame to be recorded on the video recording portion; a 
movement-vector detecting portion determining a movement-vector between image frames by comparing a preceding 
image frame with a current image frame by a field or by a frame as a unit, the image frames being formed from the video 
signal from the image-pickup portion; and a frame-shift detecting portion for summing up horizontal and vertical com- 

15 ponents of the movement-vector, separately in order to calculate a shift direction, a shift-quantity and a reference shift 
speed of the image frame as well as to detect a shift<lirection or shift-quantity of the image-pickup frame from the start 
of counting operation, wherein the monitor portion is constructed so that based on the data from the frame-shift detect- 
ing portion, the shift quantity of the image-pickup frame from the start of counting operation, the shift direction and the 
reference shift speed are displayed. 

20 A video recording apparatus in accordance with a sixth feature of the invention, comprises: an image-pickup por- 
tion outputting the video signal of picked up image frames; a movement-vector detecting portion determining a move- 
ment-vector between image frames by comparing a preceding image frame with a current image frame by a field or by 
a frame as a unit, the image frames being formed from the video signal from the image-pickup portion; a shift-angle 
specifying portion for designating a shift angle of the image-pickup portion; a view-field shift angle detecting portion 

25 wherein a horizontal or vertical shift-quantity of the image-pickup frame is determined by summing up horizontal or ver- 
tical components of the movement-vector, a horizontal or vertical view-field shift angle is determined based on the 
determined shift-quantity, a predetermined shift quantity for one-frame and a predetermined view-field angle for one- 
frame, and the determined view-field shift angle is compared with the specified shift-angle set up through the shift-angle 
specifying portion to detect whether the two values coincide to each other; and a driver portion which, based on the 

30 detection of the view-field shift angle detecting portion, drives the image-pickup portion in the horizontal or vertical 
direction within a range of shift-angle specified through the shift-angle specifying portion. 

A video recording apparatus in accordance with seventh through ninth features of the invention is constructed such 
that the frame-shift detecting portion having any one of the third through fifth features of the invention comprises a 
determining portion for determining whether the image-pickup frame is moved in the horizontal direction or in the verti- 

35 cal direction, and based on the determination, the movement of the image-pickup frame is detected as to any one of the 
horizontal and vertical directions. 

A video recording apparatus in accordance with tenth through twelfth features of the invention is constructed such 
that the determining portion having any one of the seventh through ninth features of the invention determines an oper- 
ation to be erroneous when, after the moving direction of the image-pickup frame is detected, the image-pickup frame 

40 is detected to be shifted in a direction inconsistent with the detected direction. 

The video recording apparatus of the present invention is featured as described heretofore; thus the following favo- 
rable results are expected. 

In accordance with the frame-shift detecting device of the first feature, the shift quantity of the image-pickup frame 
from the start of counting operation and the shift direction thereof can be determined with precision by detecting the 
45 movement of the image-pickup frame based on the video signal of the subject during image-taking to extract move- 
ment-vector data, and analyzing the movement-vector data thus obtained. 

Next, in accordance with the frame-shift detecting device of the second feature, it is possible to determine a field- 
view shift angle during panning (horizontal rotation) or tilting (vertical rotation), by detecting the movement of the image- 
pickup frame based on the video signal of the subject during image-taking to extract movement-vector data, and ana- 
so lyzing the movement-vector data thus obtained. 

In accordance with the video recording apparatus of the third feature, when the camera is panned or tilted, it is pos- 
sible to record an image frame at the start of moving and another image frame which is obtained after the movement 
and spaced from the first frame by an arbitrary integer number of frame-lengths and it is possible to arrange the two 
image frames to be a spatially combined frame. When this apparatus is connected to a video printer and the arbitrary 
55 integer number is set at 1 . two spatially continuously recorded image frame can be printed out to create a panoramic 
photograph. 

In accordance with the video recording apparatus of the fourth feature, the video recording portion, as recording 
the video signal of time-continuous image frames, records a first pilot signal with a first image frame at the start of count- 
ing operation, and a second pilot signal with a second image frame which is obtained after an arbitrary shift quantity 
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has been moved. When the recorded signal is reproduced, the two image frames before and after the movement can 
be recognized by detecting respective pilot signals. When this apparatus is connected to a video printer and the arbi- 
trary shift quantity is set at one-frame length, two spatially continuously recorded image frame similar to the above 
invention can be printed out to create a panoramic photograph. 
5 In accordance with the video recording apparatus of the fifth feature, an actual shift quantity of the image-pickup 

frame from the start of counting operation and a reference shift speed of the image-pickup frame are displayed on the 
monitor portion, whereby it is possible for the operator to move the camera with precision by matching the shift speed 
in conformity with the reference indicator when the camera is to be panned or tilted. 

In accordance with the video recording apparatus of the sixth feature, the operator is able to specify the moving 
10 range of the view-field shift angle for panning or tilting. By this setup, it is possible to automatically pan or tilt the camera 
within the range of the view-field shift angle. 

In accordance with the video recording apparatus of the seventh through ninth features of the invention, in any of 
the third to fifth configurations, it is possible to automatically determine whether an operation is effected in the panning 
or tilting mode, by detecting the shift direction of the frame. Accordingly, based on the result of the determination, it is 
15 possible to perform a pertinent process to panning or tilting. 

In accordance with the video recording apparatus of the tenth through twelfth feature of the invention, in any of the 
seventh to ninth configurations, after the determination of whether an operation is effected in the panning or tilting 
mode, if any shift of the frame in a direction inconsistent with an expected direction based on the determination is 
detected, the movement is determined to be erroneous, whereby it is possible to quit the operation. 

20 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig.1 is a block diagram showing a first prior art example; 

Fig. 2 is a view showing an example of a display frame in the prior art example in Fig. 1 ; 
25 Fig. 3 is a block diagram showing a second prior art example; 

Fig.4 is a perspective view showing a camera with a gyrosensor in a third prior art example; 

Fig.SA is a view showing a first image frame of a film taken by the camera shown in Fig.4; 

Fig.SB is a view showing a second image frame of the film which is taken by the camera shown in Fig.4 after the 

image of Fig.SA; 

30 Fig.6 is a view showing frame compositions which are viewed from the finder of the camera shown in Fig.4 and can 
be taken thereby. 

Fig. 7 is a block diagram showing a fifth prior art example; 

Fig.8A is a view for illustrating the detection of one-dimensional summation signal of a subject image as a refer- 
ence; 

35 Fig.SB is a view for illustrating the detection along the vertical direction in Fig.8A; 

Fig.8C is a view for illustrating the detection along the horizontal direction in Fig.8A; 

Fig.9A is a view for illustrating the detection of one-dimensional summation signal of the subject image moved; 
Fig.9B is a view for illustrating the detection along the vertical direction in Fig.9A; 
Fig.9C is a view for illustrating the detection along the horizontal direction in Fig.9A; 
40 Fig. 1 0 is a block diagram showing an embodiment of a frame-shift detecting device in accordance with a first inven- 
tion; 

Fig.1 1 is a block diagram of a movement-vector detecting portion shown in Fig. 10 
Fig.12A is a conceptual view schematically illustrating the process of extracting representative points; 
Fig.12B is a conceptual view schematically illustrating the summation at representative points in Fig.12A; 
45 Fig.13 is a block diagram showing a frame-shift detecting portion shown in Fig.10; 

Fig. 14 is a flowchart for illustrating the operation of a frame-shift detecting portion shown in Fig.10. 

Fig. 15 is a block diagram showing an embodiment of a frame-shift detecting device in accordance with a second 

invention; 

Fig. 16 is a block diagram showing a view-field angle shift detecting portion; 
so Fig. 17 is a flowchart for illustrating the operation of a view-field angle shift detecting portion shown in Fig.15; 

Fig.18A is an illustration for explaining the operation of a frame-shift detecting device shown in Fig.15; 
Fig.18B is a view showing a frame corresponding to an angle 61 in Fig.18A; 
Fig.18C is a view showing a frame corresponding to an angle 82 in Fig.18A; 

Fig. 19 is a block diagram showing an embodiment of a video recording apparatus in accordance with a third inven- 
55 tion; 

Fig. 20 is a block diagram showing a frame-shift detecting portion shown in Fig. 19; 

Fig. 21 is a flowchart for illustrating the operation of a frame-shift detecting portion shown in Fig. 19; 

Fig.22A is an illustration for explaining the operation of a video recording apparatus shown in Fig. 19 and a view of 

a subject example; 
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Fig.22B is a view showing a frame SB1 in Fgi.22A; 
Fig.22C is a view showing a frame SB2 in Fgi.22A; 

Fig.22D is a view showing a panoramic photograph composed from frames SB1 and SB2 when it is reproduced; 
Fig.23 is a block diagram showing an embodiment of a video recording apparatus in accordance with a fourth 
5 invention; 

Fig.24 is a flowchart for illustrating the operation of a frame-shift detecting portion shown in Fig.23; 
Fig.25A is a waveform chart showing a normal control signal to be recorded on the magnetic tape of a VTR; 
Fig.25B is a waveform chart showing a control signal to be served as a first pilot signal at the start of counting oper- 
ation; 

10 Fig.25C is a waveform chart showing a control signal to be served as a second pilot signal after one-frame length 
has been shifted; 

Fig.26A is an illustration for explaining the operation of a video recording apparatus shown in Fig.23 and a view of 
a subject example; 

Fig.26B is a view showing a situation in which a subject in Fig.26A was continuously taken by a camera as the cam- 
75 era is panned. 

Fig.26C is a view showing a frame of two spatially continuous frames of Fig.26B combined when they are repro- 
duced; 

Fig.27 is a block diagram showing an embodiment of a video recording apparatus in accordance with a fifth inven- 
tion; 

20 Fig. 28 is a block diagram showing a frame-shift detecting portion shown in Fig.27; 

Fig.29 is a flowchart for illustrating the operation of a frame-shift detecting portion shown in Fig.27; 
Fig.30A is a view showing a typical reference shift indicator with an actual shift indicator displayed on a monitor por- 
tion of Fig.27 immediately after the start of panning; 

Fig.30B is a view showing a display situation where a camera is shifted downward immediately after the start of 
25 movement; 

Fig.30C is a view showing a display situation in the course of the panning as to Fig.30A; 
Fig.30D is a view showing a display situation immediately before the end of panning as to Fig.30A; 
Fig.31 is a block diagram showing an embodiment of a video recording apparatus in accordance with a sixth inven- 
tion; 

30 Fig.32 is a block diagram showing a view-field shift angle detecting portion shown in Fig.31 ; and 
Fig.33 is a flowchart for illustrating the operation of a video recording apparatus shown in Fig.31 . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

35 Embodiments of the invention will hereinafter be described specifically with reference to the accompanying draw- 
ings. 

Fig. 10 is a block diagram showing an embodiment of a frame-shift detecting device in accordance with the first fea- 
ture of the invention. In this figure, light having passed through a lens 1 is photoelectrical^ converted into electric sig- 
nals by means of a CCD imaging device 2 and the thus converted electric signal is transmitted to a signal processing 

40 portion 3. In the signal processing portion 3, the inputted electric signal is separated into the luminance signal contain- 
ing brightness information and the chromatic signal containing color information while several synchronizing signals are 
added to the inputted signal and the thus treated signal is outputted to a next step (not shown). The signal processing 
portion 3 digitally supplies luminance signals required for detecting the movement of image to a movement-vector 
detecting portion 4. The lens 1, the CCD imaging device 2 and the signal processing circuit 3 constitute an image- 

45 pickup unit. 

The movement-vector detecting portion 4 detects a movement vector by the 'representative point matching 
method'. This method is carried out as follows: That is, one frame is divided into a plurality of blocks. An absolute differ- 
ential value between the luminance values of the previous frame and the current frame is determined for every repre- 
sentative point selected one in each block. All the values for representative points are summed up over the whole frame. 
so Based on the summation thus obtained and the previously obtained summation, two-dimensional shift quantity and the 
summation are analyzed to detect a movement vector. 

Fig. 1 1 is a block diagram showing the movement-vector detecting portion 4, which is composed of a preprocessing 
portion 41 , a correlation calculating portion 42, a memory portion 43 and a detecting portion 44. The preprocessing por- 
tion 41 compensates the luminance signal from the signal processing portion 3 by interpolating one-line shift in the ver- 
55 tical direction between even-numbered fields and odd-numbered fields due to the interlaced scanning scheme, and 
reduces the high-frequency noises through a digital filter. 

In the correlation calculating portion 42, the luminance signal of a previous field frame stored in the memory 43 is 
divided into b x c blocks each having a searching range of m x n pixels and one representing point of a single pixel is 
extracted from each block. Then, a luminance value a n " 1 d e (0,0) at a representing point in one of the thus divided blocks, 
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which is designated by d-th column and e-th row are compared to a luminance value a n d e (ij) within the searching 
range in the vicinity of the corresponding representative point in the current field to the above representative point in the 
previous field, so that an absolute differential value p d e (i j) between the luminance value a n " 1 de (0,0) and the luminance 
value a n de (i,j) is calculated: 

5 

Pd.eOJ) = la n d .e(U)-a n ' 1 de (0.0)| (1) 

All the thus calculated p die (U) for all the representative points are summed up to determine a summation p(i,j): 

w p(i.j) = S d Z e | Pde (i,j)| (2) 

The conceptual view of this procedure can be shown in Figs.12A and 12B. 

When the correlation calculating portion 42 has completed the summation of the absolute values for a single field, 
the detecting portion 44 evaluates the correlation between the luminance signals of the previous field image and the 

75 current field image based on the result of the correlation calculating portion 42. 

Then, the above operation is repeated for cases in which the current image is shifted by one pixel relative to the 
previous image to calculate a summation in the same manner. Then, similarly, the same operation is successively 
repeated by shifting one-pixel at a time to calculate a summation until all the searching range of m x n pixels are cov- 
ered. The thus obtained summation values are repeated evaluated as to the correlation between the two images. Based 

20 on the relation between the two-dimensional shift quantities and the summation values thus obtained from the above 
repeated operations, a displacement (i, j) at which the summation value takes the minimum value is defined as the 
movement vector: 

Movement vector = (Vi,Vj) (3) 

25 = 0 -D I ppj)* min 



Nevertheless, the movement vector (Vi, Vj) thus detected by the matching method will take only integer values 
because the unit of the shift amount between the two images is one pixel. To make matters worse, each image has been 
30 thinned or interlaced by every two lines. That is, the detecting resolution is two-pixel length, resulting in poor accuracy. 
In order to make the resolution of the movement vector more accurate, the quadratic-curve interpolation is used. 
That is, using the summation values around the minimum value of the summation correlation, the quadratic-curve inter- 
polation is effected, so that the movement vector having a resolution of not more than one-pixel can be obtained. When 
the minimum value of the summation correlation is p(i,j), the compensating quantity dx in the horizontal (X-) direction is 
35 expressed as follows: 

dx = [{ P (i-1,j) - p(i+1 ,j)}/{p(i-1,j) + p(i+1j) - 2 P (i,j)}/2] x hx (5) 
Similarly, the compensating quantity dy in the vertical (Y-) direction is expressed as follows: 

40 

dy = [{p(U-1) - p(ij+1)J/{p(i.H) + p(i.j+1) - 2p(i,j)}/2) x hy (6) 

Here, hx is two-pixel length while hy is two-pixel length (frame). 

Thus, it is possible to obtain a movement vector having a detecting resolution of not more than one-pixel length, or 

45 specifically 0.25-pixel length. The thus determined movement vector is outputted as the shift quantity in the horizontal 
and vertical directions to the frame-shift detecting portion 5. As having completed the detection, the movement-vector 
detecting portion 4 outputs a signal that instructs the end of the detection. The frame-shift detecting portion 5, as receiv- 
ing this signal, is activated to operate. 

Fig.13 is a block diagram showing an embodiment of the frame-shift detecting portion 5. That is, the frame-shift 

so detecting portion 5 includes: latch circuits 51a and 51b which separately latch the horizontal and vertical components 
of the movement-vector data outputted by every field from the movement-vector detecting portion 4; summing circuits 
52a and 52b for separately adding the horizontal and vertical components of the latched movement-vector data to 
respective horizontal and vertical summations, from the start of counting operation; a shift-direction determining circuit 
53 for determining a shift direction of the frame based on the summations; and a shift-angle calculating circuit 54 for 

55 calculating a shift-angle of the frame based on the same summations. 

The operation of the frame-shift detecting portion 5 will be explained with reference to a flowchart shown in Fig. 14. 
Initially, the latch circuit 51a and 51b separately latch the horizontal and vertical components of the movement-vector 
data outputted by every field from the movement-vector detecting portion 4 (Steps S10 and S1 1 ). 
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Subsequently, the horizontal component of the latched movement-vector data is added in the summing circuit 52a 
to the summation of the horizontal components of the movement-vector data from the start of counting operation (Step 
S12) while the vertical component of the latched movement-vector data is added in the summing circuit 52b to the sum- 
mation of the vertical components of the movement-vector data from the start of counting operation (Step S13). The 
5 summations (totaled values) indicate shift-quantitieS in the horizontal and vertical directions, from the start of counting 
operation. 

Next, the shift-direction of the frame is determined by the shift-direction determining circuit 53, from the summa- 
tions (totaled values) of the horizontal and vertical components of the movement-vector data (Step S14). In this case, 
if both the horizontal and vertical summations are zero, the state is determined as non-movement. When the summation 

io of the horizontal component is positive (+), the state is determined as a right-ward movement. When the summation of 
the vertical component is positive (+), the state is determined as an upward movement. 

Accordingly, when the summations of the horizontal and vertical components are both positive (+), the state is 
determined as a right-upward movement; and when the summations of the horizontal and vertical components are both 
negative (-), the state is determined as a left-downward movement. 

15 Further, when the horizontal summation is negative (-) while the vertical summation is positive (+), the state is 
determined as a left-upward movement; and when the horizontal summation is positive (+) while the vertical summation 
is negative (-), the state is determined as a right-downward movement. 

Next, based on the magnitudes of the horizontal and vertical summations, the shift-quantities of the frame in the 
horizontal and vertical directions are determined, respectively. From the horizontal shift-quantity and the vertical shift- 

20 quantity, the moved angle of the frame is calculated (Step S1 5). For example, suppose that the summation of the hori- 
zontal components is 100 when one-frame length is shifted. If the detected summation value is 50, it is recognized that 
the frame is moved by one half-frame length and if the summation value is 200, it is recognized that the frame is moved 
by two-frame length. Similarly, the shift in the vertical direction is determined. The shift-angle detecting circuit 54 calcu- 
lates the shift-angle of the frame from the thus determined horizontal and vertical shift-quantities. 

25 Thus, it is possible to detect exact quantities of the shift of the frame, that is, the shift-quantity and shift-direction of 
the frame. When the thus obtained information is adapted to be displayed for example, in the view-finder of the camera, 
the operator, as checking the information, becomes able to move the camera by an arbitrary amount, such as one-third 
of the whole frame angle or by two-fifth of the whole frame angle, thus obtaining increased degrees of freedom during 
the image-pickup operation. 

30 Fig. 1 5 is a block diagram showing an embodiment of a frame-shift detecting device in accordance with the second 
feature of the invention. In this figure, an image-pickup unit composed of a lens 1 , a CCD imaging device 2 and a signal 
processing circuit 3, and a movement-vector detecting portion 4 have the same configurations and operations with 
those of the previous embodiment. Therefore, detailed description is omitted. 

This embodiment has a view-field shift angle detecting portion 6 disposed in the downstream of the movement-vec- 
35 tor detecting portion 4. This view-field shift angle detecting portion 6, includes, as shown in Fig. 16, latch circuits 61a 
and 61b which separately latch the horizontal and vertical components of the movement-vector data outputted by every 
field from the movement-vector detecting portion 4; summing circuits 62a and 62b for separately adding the horizontal 
and vertical components of the latched movement-vector data to respective horizontal and vertical summations, from 
the start of counting operation; and view-field shift angle calculating circuits 63a and 63b for determining horizontal and 
40 vertical components of the view-field shift angle. 

Referring next to a flowchart shown in Fig. 17, the operation of the view-field shift angle detecting portion 6 will be 
described. First, the latch circuit 61a and 61b separately latch the horizontal and vertical components of the movement- 
vector data outputted by every field from the movement-vector detecting portion 4 (Steps S20 and S21). 

Subsequently, the horizontal component of the latched movement-vector data is added in the summing circuit 62a 
45 to the summation of the horizontal components of the movement-vector data from the start of counting operation (Step 
S22) while the vertical component of the latched movement-vector data is added in the summing circuit 62b to the sum- 
mation of the vertical components of the movement-vector data from the start of counting operation (Step S23). The 
summations indicate shift-quantities in the horizontal and vertical directions, from the start of counting operation. 

Next, the view-field shift angle calculating circuit 63a calculates the horizontal view-field shift angle, from the sum- 
so mations of the horizontal component of the movement-vector data (Step S24) while the view-field shift angle calculating 
circuit 63b calculates the vertical view-field shift angle, from the summations of the vertical component of the move- 
ment-vector data (Step S25). 

In this case, when the magnification of the zoom lens is fixed at a certain value, the horizontal view-field angle and 
vertical view-field angle for one-frame take respective predetermined values, depending upon the optical system of the 
55 lens used. For example, suppose that the horizontal view-field angle for one-frame is expressed as 0x°, the vertical 
view-field angle for one-frame is 0y°, the summation (shift quantity) of the horizontal component of the movement vector 
outputted from the movement-vector detecting portion 4 is Mx, the summation of the vertical components of the move- 
ment vector is My, the shift quantity when the view field is shifted by one-frame length in the horizontal direction is Px, 
and the shift quantity when the view field is shifted by one-frame length in the vertical direction is Py. The view-field shift 
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angle X in the horizontal direction and the view-field shift angle Y in the vertical direction, from the time when the frame 
was started to move are represented as follows: 

X = Gx° x (Mx / Px) 

5 

Y= 0y° x (My/Py). 

Figs.18A, 18B and 18C are illustrative views for explaining the operation of this embodiment. Consider a case that 
a camera CA is panned relative to a subject SB. In this case, as shown in Fig.1 8A, the horizontal view-field angle before 

10 movement is represented by an angle 01 while the horizontal view-field angle after movement is represented by an 
angle 02. The frame of the angle 01 picks up the subject SB from the front as shown in Fig.18B while the frame of the 
angle 02 picks up the right-half of the subject SB as shown in Fig.lSB. In this case, as the zooming magnifications are 
the same, the view-field angles 81 , 02 are constant. 

Suppose that horizontal view-field angle 0x° for one-frame is 45°. In this case, if the summation value Mx of the hor- 

is izorrtal component of the movement-vector outputted from the movement-vector detecting portion 4 is 200 and the shift 
quantity in the horizontal direction when one-frame length is shifted is 600, the horizontal view-field shift angle 0m is 
calculated as follows: 

9m = 45° x (200/600) = 15°. 

20 

The vertical view-field shift angle can be calculated in the same manner. Thus, the operator can get information on the 
swing angle of the camera when the camera is panned or tilted during picture-taking. This feature is useful when a pre- 
determined amount of panning or tilting is to be done. 

Fig. 19 is a block diagram showing an embodiment of a video recording apparatus in accordance with the third, the 
25 seventh through ninth and the tenth through twelfth features of the invention. In this figure, an image-pickup unit com- 
posed of a lens 1 , a CCD imaging device 2 and a signal processing circuit 3, and a movement-vector detecting portion 
4 have the same configurations and operations with those of the previous embodiment. Therefore, detailed description 
is omitted. 

In this embodiment, a VTR (Video Tape Recorder) 7 is connected to the output side of the signal processing portion 

30 3. A monitor portion 8 for displaying video image to be recorded on the VTR 7 or to be reproduced from the VTR 7 is 
connected to the VTR 7. Connected to the output side of the movement-vector detecting portion 4 is a frame-shift 
detecting portion 9. All the above components, or the lens 1 through the frame-shift detecting portion 9 constitute a 
camera-integrated VTR with a built-in monitor. 

Fig. 20 is a block diagram showing an embodiment of the frame-shift detecting portion 9. This frame-shift detecting 

35 portion 9, includes: latch circuits 91a and 91b which separately latch the horizontal and vertical components of the 
movement-vector data outputted by every field from the movement-vector detecting portion 4; summing circuits 92a and 
92b for separately adding the horizontal and vertical components of the latched movement-vector data to respective 
horizontal and vertical summations, from the start of counting operation; a pan/tilt determining circuit 93 for determining 
whether panning and/or tilting is effected, by checking the horizontal summation and the vertical summation; a selecting 

40 circuit 94 for selecting one of the summations outputted from the summing circuits 92a and 92b, based on the result of 
the determination in the pan/tilt determining circuit 93; a reference value generating circuit 95 for outputting a shift- 
quantity for each one-frame as a reference value, based on the result of the determination in the pan/tilt determining 
circuit 93; and a comparing circuit 96 for comparing the summation value from the selecting circuit 94 with the reference 
value from the reference value generating circuit 95, thus to detect a shift for one-frame. 

45 Referring next to a flowchart shown in Fig.21 , the operation of the frame-shift detecting portion 9 will be described. 
This process is activated when the operator designates the panorama recording mode through a control portion (not 
shown) in the state where the camera is being operated to take a view. First, one field of the video image at that moment 
is stored in an image memory in the signal processing portion 3, as an initial video image (a first video image) at the 
start of counting operation (Step S30). Here, the memory portion 43 in the movement-vector detecting portion 4 may 

so commonly be used for the image memory. 

Then, the latch circuit 91a and 91b separately latch the horizontal and vertical components of the movement-vector 
data outputted by every field from the movement-vector detecting portion 4 (Steps S31 and S32). Subsequently, the 
horizontal component of the latched movement-vector data is added in the summing circuit 92a to the summation of the 
horizontal components of the movement-vector data from the start of counting operation (Step S33) while the vertical 

55 component of the latched movement-vector data is added in the summing circuit 92b to the summation of the vertical 
components of the movement-vector data from the start of counting operation (Step S34). The summations indicate 
shift-quantities in the horizontal and vertical directions, from the start of counting operation. 

Subsequently, whether determination of pan/tilt is made is determined by the pan/tilt determining circuit 93 (Step 
S35). The step is done because this embodiment is to record a panorama video picture spatially continuously in the hor- 
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izontal direction or in the vertical direction by panning or tilting the camera and the following operation becomes different 
depending on panning or tilting. 

Since, at the start of the mode, or when the camera stands still, the determination of pan/tilt has not been done, the 
determination of pan/tilt is effected (Step S36). In this determining process, when the absolute value of the output from 

5 the summing circuit 92a is detected to be more than a certain level and the absolute value of the output from the sum- 
ming circuit 92b is detected to be not more than a certain level, the movement is determined as a panning operation, 
and the system sets up the panning mode (Step S37). In contrast, when the absolute value of the output from the sum- 
ming circuit 92b is detected to be more than a certain level and the absolute value of the output from the summing circuit 
92a is detected to be not more than a certain level, the movement is determined as a tilting operation, and the system 

10 sets up the tilting mode (Step S38). 

When the absolute value of the output from the summing circuit 92a is detected to be more than a certain level and 
the absolute value of the output from the summing circuit 92b is detected to be more than a certain level, the camera is 
determined to have been moved two-dimensionally. Accordingly, in some cases depending upon the amount of the 
shift, the spatially continuous panoramic video taking becomes impossible, so that the system determines the operation 

15 as an error. In response to this determination, the first video image stored in the image memory is made clear and all 
the circuits related are reset and the error message is displayed on the monitor portion 8, to thereby end the operation 
(Step S39). 

When the absolute values of the output from both the summing circuits 92a and 92b are both zero or not more than 
certain levels, the camera is determined not to have been moved yet, so that Step S31 and the following steps are 

20 repeated. In this case, if the camera has not been moved after the lapse of a predetermined time from the start of the 
operation, the operation is determined to be erroneous, and the process in Step S39 is effected to end the operation. 

A setup operation of the panning mode (Step S37) is to cause the selecting circuit 94 to select the output from the 
summing circuit 92a and to cause the reference value generating circuit 95 to generate a reference value equivalent to 
the shift quantity of one frame length in the horizontal direction. A setup operation of the tilting mode (Step S38) is to 

25 cause the selecting circuit 94 to select the output from the summing circuit 92b and to cause the reference value gen- 
erating circuit 95 to generate a reference value equivalent to the shift quantity of one frame length in the vertical direc- 
tion. 

In the aforementioned Step S35, if the pan/tilt determination has been already made, a judgment of whether any 
erroneous operation occurs is made in the pan/tilt determining circuit 93 (Step S40). This process is provided to deal 

30 with such cases that, for example, after the operation is determined as in the panning mode and the panning mode is 
set up. the camera is moved significantly in the vertical direction, or after the operation is determined as in the tilting 
mode and the tilting mode is set up, the camera is moved significantly in the horizontal direction. In any of such cases, 
it becomes impossible to record a panoramic video image spatially continuous. Accordingly, the error treatment is a 
must. When an operation is determined to be an error, the first video image stored in the image memory is made clear 

35 and all the circuits related are reset and the error message is displayed on the monitor portion 8, to thereby end the 
operation (Step S39). 

When the setup of the panning mode (Step S37) or the tilting mode (Step S38) is complete, and if the operation is 
determined to be free from error in the Step S40, a judgment of whether the movement from the start of the operation 
is more than one-frame length is made in the comparing circuit 96 (Step S41). If the movement has not exceeded yet, 

40 the same process is repeated from Step S31 wherein the horizontal and vertical components of the movement-vector 
data outputted by every field from the movement-vector detection portion 4 are separately latched and summed up. 
Since the movement has not exceeded the one-frame length at the outset of the operation, the process from Step S31 
and the following steps is effected. 

In the process of Step S41 , if the summation of the movement-vector data becomes equal to or greater than one- 

45 frame length, one field of the video image at that time should be stored into the image memory in the signal processing 
portion 3, as a second frame (an image after one-frame length is moved) (Step S42). After this operation, the VTR 7 is 
controlled so that the spatially continuous two frames of video signals stored in the signal processing portion 3 are 
recorded onto the magnetic tape for some seconds for each (Step S43). Subsequently, the two frames of the video sig- 
nals stored in the signal processing portion 3 are made clear, and all the circuits related are reset (Step S44) to end the 

so operation. 

In the above description of the embodiment, although the video signals for both the first and the second frames 
were to be temporarily stored into the image memory in the signal processing portion 3 and thereafter recorded onto 
the VTR 7. However, the system can be configurated so that the video signal for the first frame may be recorded onto 
the VTR 7 immediately after the signal for the first frame is stored into the image memory, thereafter the video signal for 
55 the second frame may be recorded onto the VTR 7 immediately after the signal for the second frame is stored into the 
image memory. This method allows saving of the image memory. 

Figs.22A through 22D are views showing an example of recorded images in accordance with this embodiment. 
When a subject SB in Fig.22A is taken as the camera is panned, the VTR 7 records an image frame SB1 shown in 
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Fig.22B for some seconds as a frame at the start of counting operation, and then effects recording of an image frame 
SB2 shown in Fig.22C for some seconds as a second frame after the one-frame length has been panned. 

In reproducing the thus recorded two video images SB1 and SB2 from the VTR 7, the operator, as observing the 
playback picture displayed on the monitor portion 8, may make a printout operation by means of a video printer 10 

5 which is connected to the output terminal of the VTR 7. By this operation, a panoramic photograph spatially continuous 
can be created as shown in Fig.22D. 

Fig.23 is a block diagram showing an example of a video recording apparatus in accordance with the fourth, the 
seventh through ninth and the tenth through twelfth features of the invention. In this figure, an image-pickup unit com- 
posed of a lens 1 , a CCD imaging device 2 and a signal processing circuit 3, and a movement-vector detecting portion 

10 4 have the same configurations and operations with those of the previous embodiment. Therefore, detailed description 
is omitted. 

In this embodiment, similarly to the previous embodiment (Fig.19), a VTR 7 as a video recording apparatus is con- 
nected to the output side of the signal processing portion 3. A monitor portion 8 for displaying video image to be 
recorded on the VTR 7 or to be reproduced from the VTR 7 is connected to the VTR 7. Connected to the output side of 

15 the movement-vector detecting portion 4 is a frame-shift detecting portion 9. All the above components, or the lens 1 
through the frame-shift detecting portion 9 constitute a camera-integrated VTR with a built-in monitor. 

Since the configuration of the frame-shift detecting portion 9 is the same with that of the previous embodiment 
(Fig.20), the detailed description is omitted. But, it should be noted that since the video image is time-continuously 
recorded on the VTR 7 in this embodiment, there is no need for controlling the image memory in the signal processing 

20 portion 3 by the output of the frame-shift detecting portion 9 as effected in the previous embodiment. 

Referring next to a flowchart shown in Fig. 24, the operation of the frame-shift detecting portion 9 of this embodi- 
ment will be described. This process is activated when the operator starts image-taking a subject. Initially, the video sig- 
nal which is time-continuously outputted from the signal processing portion 3 is recorded continuously on the magnetic 
tape of the VTR 7 (Step S50). During this operation, a control signal having a waveform periodically changing in a ratio 

25 of 60±5% to 40+5% as shown in Fig.25A is simultaneously recorded by every field on the control track of the magnetic 
tape. 

In this condition, as the operator designates the panoramic recording through the control portion (not shown), the 
frame-shift detecting portion 9 resets internal circuits and starts counting of one-frame shift (Step S51) while a pilot sig- 
nal indicating the start of counting operation is recorded on the tape (Step S52). For the pilot signal, the above control 

30 signal is made to also serve as the pilot signal, by changing the duty ratio of the control signal into the ratio of 70±5% 
to 30±5% as shown in Fig.25B. The pilot signal should not be limited to this configuration, as will be shown hereinafter. 

Subsequently, the process from Step S53 to Step S63 is effected. Since a series of these steps are the same with 
those from Step S31 to Step S41 shown in Fig.21 in the previous embodiment, the detailed description is omitted. How- 
ever, since in this embodiment the video signal is continuously recorded on the VTR 7; when the operation is deter- 

35 mined as to be an error in Step S58 or Step S63, only the error message is displayed (Step S61 ), and the operation is 
ended. 

In Step S63, when the summation of the movement-vector data is determined to be equal to or more than one- 
frame length, a pilot signal indicating that one-frame has been shifted is recorded on the magnetic tape by the VTR 7, 
(Step S64) and the operation is ended. The control signal is made to also serve as this pilot signal, by changing the duty 
40 ratio of the control signal into the ratio of 80+5% to 20+5% as shown in Fig.25C. 

Figs.26A through 26C are views showing an example of video recording in accordance with this embodiment, when 
a subject SB shown in Fig.26A is taken as the camera is panned continuously from the left to the right. Fig.26B shows 
a series of the image taking situations as the camera is being panned. Suppose that the frame recorded at the start of 
counting operation is a frame SBc marked with a white star. When this frame is recorded, the control signal of the ratio 
45 shown in Fig.25B which also serves as the pilot signal is recorded on the control track. Suppose that the frame recorded 
after one-frame length has been shifted is a frame SBh marked with a black star. When this frame is recorded, the con- 
trol signal of the ratio shown in Fig.25C which also serves as the pilot signal is recorded on the control track. 

After the image-taking, as the thus recorded video signals are reproduced, the image frame SBc added with the 
first pilot signal and the image frame SBh added with the second pilot signal are reproduced as a single spatially con- 
so tinuous frame as shown in Fig.26C. In this way, it is possible to record spatially continuous two image frames as a single 
image frame while normal video-image taking is being performed. Further, the information of the two image frames 
added with the pilot signals is sent to a video printer 10 for printout, whereby it is possible to create a spatially continu- 
ous panoramic photograph. 

Fig.27 is a block diagram showing an example of a video recording apparatus in accordance with the fifth, the sev- 
55 enth through ninth and the tenth through twelfth features of the invention. In this figure, an image-pickup unit composed 
of a lens 1 . a CCD imaging device 2 and a signal processing circuit 3, and a movement-vector detecting portion 4 have 
the same configurations and operations with those of the previous embodiment. Therefore, detailed description is omit- 
ted. 
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In this embodiment, similarly to the previous embodiment (Fig.23), a VTR 7 is connected to the output side of the 
signal processing portion 3. A monitor portion 8 for displaying video image to be recorded on the VTR 7 or to be repro- 
duced from the VTR 7 is connected to the VTR 7. Connected to the output side of the movement-vector detecting por- 
tion 4 is a frame-shift detecting portion 1 1 . Connected to the output side of the frame-shift detecting portion 1 1 is an on- 

5 screen display (OSD) circuit 12. The OSD circuit 12 is a circuit for generating designated titles such as characters, 
marks etc., superimposed on the screen of the monitor portion 8. All the above components, or the lens 1 through the 
OSD circuit 12 constitute a camera-integrated VTR with a built-in monitor. 

Fig.28 is a block diagram showing an embodiment of a frame-shift detecting portion 1 1 . The same components in 
this portion 1 1 with those in the frame-shift detecting potion 9 as already described are allotted with the same reference 

10 numerals and the detailed description is omitted. The frame-shift detecting portion 1 1 includes; latch circuits 91a, 91b, 
summing circuits 92a, 92b, a pan/tilt determining circuit 93, a selecting circuit 94, a reference value generating circuit 
95, and a comparing circuit 96. The portion 1 1 further has a reference shift-quantity calculating circuit 97 and an actual 
shift-quantity calculating circuit 98, both connected in parallel with the pan/tilt determining circuit 93. 

The reference shift-quantity calculating circuit 97 is a circuit for calculating a reference speed in order to make the 

is operator move the frame at a speed which allows the system to detect the movement-vector data with good accuracy. 
The calculated reference speed data is displayed on the monitor portion 8. On the other hand, the actual shift-quantity 
calculating circuit 98 is a circuit for calculating an actual shift speed in order to inform the operator of the actual moving 
speed of the camera. The calculated actual speed data is displayed on the monitor portion 8. The output from the ref- 
erence shift-quantity calculating circuit 97 as well as the output from the actual shift-quantity calculating circuit 98 is 

20 delivered to a data converting circuit 99, where the data is converted into display data instructing the display of charac- 
ters, marks etc., to be outputted to the OSD 12. 

Referring next to a flowchart shown in Fig.29, the operation of the frame-shift detecting portion 1 1 of this embodi- 
ment will be described. Here, the process from Step S70 to Step S82 is the same with that from Step S50 to Step S62 
shown in Fig.24 in the previous embodiment, the detailed description is omitted. 

25 As Steps S79 and S80 are corrplete, or when the operation is determined to be free from error at Step S82, the 
reference shift-quantity calculating circuit 97 calculates a reference shift-quantity (Step S83). This calculation is done in 
order to make the operator move the frame of the camera at a speed which allows the system to detect the movement- 
vector data with good accuracy and this calculated reference speed is displayed on the monitor portion 8. 

Suppose that, for example, when the movement-vector data is detected with good accuracy, the value of the move- 

30 ment-vector data transmitted by every field from the movement-vector detecting portion 4 is 10. In such an ideal case 
in which the summation is added with 1 0 every time a movement-vector is outputted from the movement-vector detect- 
ing portion 4, the increasing rate of the summation of the movement-vector data can be assumed to be a reference 
speed when the movement-vector data is detected with good accuracy. 

Now, supposed that the summation of the movement-vector data when one-frame shift is made is 2,400, and when 

35 the movement-vector data can be detected with good accuracy, the value of the movement-vector data transmitted by 
every field from the movement-vector detecting portion 4 is 10. In this case, if 150 times of detection of the movement 
is made, the ideal shift can be calculated as follows: 

10 x 150 / 2400 = 0.625. 

40 

That Is, this indicates a reference that if 62.5% of one-frame shift is made during 1 50 times of detection, the movement 
of the frame is carried out with good accuracy 

Next, the actual shift-quantity calculating circuit 98 calculates an actual shift quantity of the image-pickup frame by 
the movement of the camera from the start of counting operation (Step S84). Suppose that for instance, the summation 
45 of the movement-vector data when one-frame length has been shifted, is 2,400; if the summation of the movement-vec- 
tor data is 800, 

800 / 2400 = 0.333. 

so That is, this situation indicates that the frame has been shifted by 33.3% of one-frame length shift. 

Subsequently, the previously determined reference data and the data indicating the actual shift quantity are con- 
verted in the data converting circuit 99 into display data (Step S85). The converted data is outputted to the OSD 12 
(Step S86). The OSD 12 outputs character signals etc., in conformity with the converted data, to the monitor portion 8. 
The monitor portion 8 displays a video image based on the video signal outputted from the signal processing portion 3 

55 with the characters and the like superimposed based on the character signals etc.. outputted from the OSD 1 2. 

Next, a judgment of whether the movement is more than one-frame length is made in the comparing circuit 96 (Step 
S87). If the movement has not exceeded yet, the same process is repeated from Step S73 wherein the horizontal and 
vertical components of the movement-vector data outputted by every field from the movement-vector detection portion 
4 are separately latched and summed up. 
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If the summation of the movement-vector data becomes equal to or exceeds one-frame length, a pilot signal indi- 
cating that one-frame has been shifted is recorded on the magnetic tape of the VTR 7 (Step S88) in response to the 
output from the comparing circuit 96. Then, the operation is ended. Here, the control signal is made to also serve as the 
pilot signal, by changing the duty ratio of the control signal into the ratio of 80±5% to 20+5% as shown in Fig.25C. 

s Now, an example of the reference-shift indicator and the actual-shift indicator to be displayed on the monitor portion 

8 during panning will be explained with reference to Figs.30A through 30D. Fig.30A is a display immediately after the 
start of the panning. An upper bar Br1 is an indicator showing the reference-shift speed while a diamond-shaped mark 
Br2 is an indicator showing the actual-shift speed. Lines Sh are the horizontal references, whereas lines Sv are the ver- 
tical references. Fig.30B shows a case where the camera is shifted downward immediately after the start of movement, 

io therefore the diamond mark Br2 is positioned below as compared to the position in Fig.30A. Fig.30C is a display show- 
ing a situation in the course of panning. In this figure, the bar Br1 indicating the reference-shift speed is in advance as 
compared to the diamond Br2 indicating an actual-shift speed. This indicates that the actual-shift speed is delayed rel- 
ative to the reference-shift speed. The operator, as checking the display, should move the camera so that the diamond 
Br2 may move together with the reference indicator, whereby it is possible to effect panning of the camera with preci- 

15 sion. In the rear of the indicator Br2, another bar Br3 is displayed for the comparison with the bar Br1 . Fig.30D is a dis- 
play showing a situation immediately after the shift end. The operator should stop panning of the camera when the 
diamond Br2 reaches this position. 

Fig. 31 is a block diagram showing an example of a video recording apparatus in accordance with the sixth feature 
of the invention. In this figure, an image-pickup unit composed of a lens 1, a CCD imaging device 2 and a signal 

20 processing circuit 3, and a movement-vector detecting portion 4 have the same configurations and operations with 
those of the previous embodiment. Therefore, detailed description is omitted. 

This embodiment has a view-field shift angle detecting portion 13 connected to the output side of the movement- 
vector detecting portion 4. This view-field shift angle detecting portion 13 is to control a pan/tilt driver portion 15 within 
a view-field angle designated by a shift-angle specifying portion 14. This pan/tilt driver portion 15 drives the automatic 

25 panning head (APH) 1 6 attached to the camera. 

Fig.32 is a block diagram of an embodiment of the view-field shift angle detecting portion 1 3. Here, the same com- 
ponents as in the view-field shift angle detecting portion 6 (Fig. 16) are allotted with the same reference numerals and 
therefore the detailed description is omitted. The view-field shift angle detecting portion 13 includes latch circuits 61a 
and 61b; summing circuits 62a and 62b; and view-field shift angle calculating circuits 63a and 63b and further has com- 

30 paring circuits 64a and 64b connected to the output side of the view-field shift angle calculating circuits 63a and 63b, 
respectively. The comparing circuit 64a and 64b is made to receive reference data in accordance with an indicating 
angle which is generated from a reference value generating circuit 65 based on the instruction from the shift-angle 
specifying portion 1 4. 

Referring next to a flowchart shown in Fig. 33, the operation of the view-field shift angle detecting portion 13 will be 
35 described. First, the operator inputs specified shift-angles as to the horizontal and vertical directions through the shift- 
angle specifying portion 1 4 (Steps S90, S91 ). In this case, if a panning operation is to be done, the specified shift-angle 
in the vertical direction is zero, whereas if a tilting operation is to be done, the specified shift angle in the horizontal 
direction is zero. 

Subsequently, the camera is activated to move toward the designated direction (Step S92). As the camera starts to 
40 move, movement-vector data is outputted by every field from the movement-vector detecting portion 4. The latch cir- 
cuits 61 a and 61b separately latch the horizontal and vertical components of the movement-vector data (Steps S93 and 
S94). 

Subsequently, the horizontal component of the latched movement-vector data is added to the summation of the 
horizontal components of the movement-vector data from the start of counting operation (Step S95) while the vertical 

45 component of the latched movement-vector data is added to the summation of the vertical components of the move- 
ment-vector data from the start of counting operation (Step S96). From the thus obtained summations of the horizontal 
and vertical components of the movement-vector data, calculations for determining the view-field shift angle are per- 
formed (Steps S97 and S98). Here, the processes from Steps S93 to S98 are the same with those from Steps S20 to 
S25 already shown in Fig. 17, so that a further description in detail is omitted. 

so Subsequently, in the comparing circuit 64a, the horizontal view-field shift angle determined by the view-field shift 
angle calculating circuits 63a is compared with the data in accordance with the specified horizontal angle outputted 
from the reference value generating circuit 65 (Step S99). As a result of the comparison, if the horizontal view-field shift 
angle is greater than the specified angle, the pan/tilt driver portion 15 is controlled to drive the APH 16 so that the pan- 
ning direction of the camera can be reversed (Step S100). 

55 When the horizontal view-field shift angle is equal to or smaller than the specified angle, or when the process at 
Step S100 is complete; in the comparing circuit 64b, the vertical view-field shift angle determined by the view-field shift 
angle calculating circuits 63b is compared with the data in accordance with the specified vertical angle outputted from 
the reference value generating circuit 65 (Step S1 01 ). As a result of the comparison, if the vertical view-field shift angle 
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is greater than the specified angle, the pan/tilt driver portion 1 5 is controlled to drive the APH 1 6 so that the tilting direc- 
tion of the camera can be reversed (Step S102). 

When the vertical view-field shift angle is equal to or smaller than the specified angle, or when the process at Step 
S102 is complete, the operation is returned to the process in Step S93, from where the same process is repeated, that 
is, the separate input of the horizontal and vertical components of the movement-vector data outputted by every field 
from the movement-vector detecting portion 4 is repeated. In the above description, although the rotational direction of 
the camera is reversed at Step 100 or Step 102, it is also possible that the rotation of the camera is merely stopped. 

These are the embodiments of the invention. In the above description of all the embodiments, although the 'repre- 
sentative point matching method' is used as the detecting technique in the movement-vector detecting portion, the 
present invention should not be limited to this method. Other techniques for detecting the movement-vector such as the 
gradient method', 'phase-correlation' method may of course be applied to the invention. 

In the above third to fifth embodiments, although a VTR is used as the video recording portion, the present inven- 
tion is not limited to this configuration. That is, other video recording apparatuses may of course be applied to the inven- 
tion, such as, for example, semiconductor memory devices including a flash memory, a nonvolatile ferroelectric memory 
etc.! magnetic recording and reproducing apparatuses using an FD (floppy disc) or the like, or magneto-optical record- 
ing and reproducing apparatuses using a CD-ROM or the like. Accordingly, the present invention should not be limited 
to the VTR having a built-in camera. 

In the above third to fifth embodiments, although the determination of panning or tilting is automatically done, the 
present invention is not limited to this configuration. The system may be constructed such that the operator may man- 
ually select a mode from the panning or tilting mode or the system may be dedicated to the panning mode or the tilting 
mode. 

Although the above third to fifth embodiments are constructed so that one-frame length shift in the horizontal or ver- 
tical direction is detected, the present invention is not limited to this configuration. The shift amount to be detected may 
of course be set at any arbitrary quantity. 

Although the above fourth to fifth embodiments are constructed so that the control signal is made to also serve as 
the pilot signal, by changing its duty ratio, the present invention is not limited to this configuration. For instance, the pilot 
signal can be recorded as a proper signal, into the PCM areas of 8 mm VTR, the sub-code areas of the digital VTR or 
etc. Further, when the invention is applied to the other video recording apparatus than VTRs, the pilot signal pertinent 
to the specifications of the apparatus may and should be recorded. 

In accordance with the frame-shift detecting device of the first or second feature of the invention, the shift quantity 
of the image-pickup frame from the start of counting operation can be determined with precision, based on the video 
signal of the frames during image-taking. Further, the view-field shift angle during panning or tilting can also be deter- 
mined with precision. 

In accordance with the video recording apparatus of the third or fourth feature of the invention, when the camera is 
panned or tilted, a first image frame at the start of moving and a second image frame at the end of moving are recorded 
sequentially, or the two images are recorded together with respective pilot signals so that the recorded frames in ques- 
tion may be specified. Any of the above configurations makes it possible to record two spatially continuous image 
frames and reproduce the two frames as a single picture. As a result, it becomes possible to print out the two continuous 
frames by means of a video printer. Alternatively, it is also possible to display the two images in two monitor arranged 
side by side to create a wide panoramic image frame. 

In accordance with the video recording apparatus of the fifth feature of the invention, it is possible to display an 
exact shift quantity of the image-pickup frame by detecting the movement of the whole frame with precision. Further, an 
actual shift quantity of the image-pickup frame is displayed together with a reference speed at which the frame would 
be moved accurately. This function allows the operator to move the frame with precision. Since the apparatus can be 
downsized and made light-weighted, it can be easily handled for being carried and moved as well as for picture taking. 

In accordance with the video recording apparatus of the sixth feature of the invention, a moving range of the view- 
field shift angle can be specified by the operator and automatic panning or tilting of the camera can be effected within 
the specified range. Accordingly, although in the prior art configuration, the operation of panning or tilting could be done 
at only predetermined angles, it is possible to change the moving range of the view-field shift angle, in conformity with 
the scene to be taken. Accordingly, the degrees of freedom in the image taking can be improved. 

In accordance with the video recording apparatus of the seventh through ninth features of the invention, it is possi- 
ble to automatically determine whether an operation is effected in the panning or tilting mode, by detecting the shift 
direction of the frame. Accordingly, based on the result of the determination, it is possible to perform a pertinent process 
to panning or tilting. 

In accordance with the video recording apparatus of the tenth through twelfth features of the invention, after the 
determination of whether an operation is effected in the panning or tilting mode, if any shift of the frame in a direction 
inconsistent with an expected direction based on the determination is detected, the movement is determined to be erro- 
neous, whereby it is possible to quit the operation. 
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Claims 

1 . A frame-shift detecting device comprising : 

an image-pickup portion outputting the video signal of picked up image frames; 
5 a movement-vector detecting portion determining a movement-vector between image frames by comparing 

a preceding image frame with a current image frame by a field or by a frame as a unit, said image frames being 
formed from the video signal from said image-pickup portion; and 

a frame-shift detecting portion for summing up horizontal and vertical components of said movement-vector, 
separately in order to detect a shift-direction or shift-quantity of the image-pickup frame from the start of counting 
w operation. 

2. A frame-shift detecting device comprising: 

an image-pickup portion outputting the video signal of picked up image frames; 

a movement-vector detecting portion determining a movement-vector between image frames by comparing 
15 a preceding image frame with a current image frame by a field or by a frame as a unit, said image frames being 
formed from the video signal from said image-pickup portion; and 

a view-field shift angle calculating portion for determining a horizontal or vertical view-field shift angle, 
wherein said horizontal or vertical view-field shift angle is determined by the steps of: summing up horizontal or ver- 
tical components of said movement-vector, separately to determine a horizontal or vertical shift-quantity of the 
20 image-pickup frame; and calculating the shift angle in question, based on the shift-quantity, a predetermined shift 
quantity for one-frame and a predetermined view-field angle for one-frame. 

3. A video recording apparatus comprising: 

an image-pickup portion outputting the video signal of picked up image frames; 
25 a video recording portion for recording said video signal by a field or a frame as a unit; 

a movement-vector detecting portion determining a movement-vector between image frames by comparing 
a preceding image frame with a current image frame by a field or by a frame as a unit, said image frames being 
formed from the video signal from said image-pickup portion; and 

a frame-shift detecting portion for summing up horizontal and vertical components of said movement-vector, 
30 separately in order to detect a shift-direction or shift-quantity of said image-pickup frame from the start of counting 
operation, 

said video recording apparatus being characterized in that said video recording portion records first video 
information as to a first frame at the start of counting operation and second video information as to a second frame 
at the time when said frame-shift detecting portion detects that the image pickup frame has been shifted by a pre- 
35 determined shift quantity. 

4. A video recording apparatus comprising: 

an image-pickup portion outputting video signal of picked up image frames; 
a video recording portion for recording said video signal by a field or a frame as a unit; 
40 a movement- vector detecting portion determining a movement- vector between image frames by comparing 

a preceding image frame with a current image frame by a field or by a frame as a unit, said image frames being 
formed from the video signal from said image-pickup portion; and 

a frame-shift detecting portion for summing up horizontal and vertical components of said movement-vector, 
separately in order to detect a shift-direction or shift-quantity of the image-pickup frame from the start of counting 
45 operation, 

said video recording apparatus being characterized in that said video recording portion, as recording said 
video signal continuously, records a first pilot signal at the start of counting operation and a second pilot signal at 
the time when said frame-shift detecting portion detects that the image pickup frame has been shifted by a prede- 
termined shift quantity. 

50 

5. A video recording apparatus comprising: 

an image-pickup portion outputting the video signal of picked up image frames; 

a video recording portion for recording said video signal by a field or a frame as a unit; 

a monitor portion displaying the image frame to be recorded on said video recording portion; 
55 a movement-vector detecting portion determining a movement-vector between image frames by comparing 

a preceding image frame with a current image frame by a field or by a frame as a unit, said image frames being 
formed from the video signal from said image-pickup portion; and 

a frame-shift detecting portion for summing up horizontal and vertical components of said movement-vector, 
separately in order to calculate a shift-direction, a shift-quantity and a reference shift speed of the image frame as 
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well as to detect a shift-direction or shift-quantity of the image-pickup frame from the start of counting operation, 

wherein said monitor portion is constructed so that based on the data from said frame-shift detecting por- 
tion, the shift quantity of the image-pickup frame from the start of counting operation, the shift direction and the ref- 
erence shift speed are displayed. 

6. A video recording apparatus comprising: 

an image-pickup portion outputting the video signal of picked up image frames; 

a movement-vector detecting portion determining a movement-vector between image frames by comparing 
a preceding image frame with a current image frame by a field or by a frame as a unit, said image frames being 
formed from the video signal from said image-pickup portion; 

a shift-angle specifying portion for designating a shift angle of said image-pickup portion; 

a view-field shift angle detecting portion wherein a horizontal or vertical shift-quantity of said image-pickup 
frame is determined by summing up horizontal or vertical components of said movement-vector, a horizontal or ver- 
tical view-field shift angle is determined based on the determined shift-quantity, a predetermined shift quantity for 
one-frame and a predetermined view-field angle for one-frame, and the determined view-field shift angle is com- 
pared with the specified shift-angle set up through said shift-angle specifying portion to detect whether the two val- 
ues coincide to each other; and 

a driver portion which, based on the detection of said view-field shift angle detecting portion, drives said 
image-pickup portion in the horizontal or vertical direction within a range of shift-angle specified through said shift- 
angle specifying portion. 

7. A video recording apparatus according to Claim 3 wherein said frame-shift detecting portion comprises a determin- 
ing portion for determining whether the image-pickup frame is moved in the horizontal direction or in the vertical 
direction, and based on the determination, the movement of the image-pickup frame is detected as to any one of 
the horizontal and vertical directions. 

8. A video recording apparatus according to Claim 4 wherein said frame-shift detecting portion comprises a determin- 
ing portion for determining whether the image-pickup frame is moved in the horizontal direction or in the vertical 
direction, and based on the determination, the movement of the image-pickup frame is detected as to any one of 
the horizontal and vertical directions. 

9. A video recording apparatus according to Claim 5 wherein said frame-shift detecting portion comprises a determin- 
ing portion for determining whether the image-pickup frame is moved in the horizontal direction or in the vertical 
direction, and based on the determination, the movement of the image-pickup frame is detected as to any one of 
the horizontal and vertical directions. 

10. A video recording apparatus according to Claim 7 wherein said determining portion determines an operation to be 
erroneous when, after the moving direction of the image-pickup frame is detected, the image-pickup frame is 
detected to be shifted in a direction inconsistent with said detected direction. 

1 1 . A video recording apparatus according to Claim 8 wherein said determining portion determines an operation to be 
erroneous when, after the moving direction of the image-pickup frame is detected, the image-pickup frame is 
detected to be shifted in a direction inconsistent with said detected direction. 

12. A video recording apparatus according to Claim 9 wherein said determining portion determines an operation to be 
erroneous when, after the moving direction of the image-pickup frame is detected, the image-pickup frame is 
detected to be shifted in a direction inconsistent with said detected direction. 

1 3. A frame shift detecting device for detecting the shifting of an image relative to an image detection unit, said unit out- 
putting a video signal comprising successive image frames, the device including means for separately summing 
increments of movement in respective first and second orthogonal directions, and means for producing from the 
output of the summing means data concerning the direction and amount of the shifting. 
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